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[57] 


ABSTRACT 


An ABX testing device for comparing for example two 
video or audio programs is provided to determine if the two 
programs can be distinguishable. The device selects ran- 
domly one of the programs and the tester can listen or view 
and compare sequentially the random selection to either of 
the programs. The tester then can vote by designating one of 
the programs as being the randomly selected program. The 
designations are accumulated and statistics are generated 
regarding the same. Preferably the device includes a control 
box, a switch mechanism and a PC coupled to both by 
standard parallel cable. 
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. METHOD AND APPARATUS FOR TESTING test is then repeated for this new value of X. After a test run 

THE QUALITY OF RECORDED of a plurality of tests, the results of the test, i.e., how many 

INFORMATION times the tester was able to distinguish A or B is displayed 

and optionally logged. The whole mn can be repeated for a 

this application claims the benefit of provisional appli- s second tester and the results can be logged again. In this 

cation no. 60/057,176 filed Aug. 26, 1997 manner an objective determination is made as to whether the 

two program s A and B are distinguishable. 

BACKGROUND OF THE INVENTIGN ^ preferred embodiment, the testing device includes a 

A. Field of Invention control box with switches for selecting the programs A, B 
This appUcation pertains to a method and apparatus for '° and X and a voting sN^tch for aUowing the tester to vote, m 

testing the quaUty recorded of audio and video programs and ™^ ^""^ ^ ^^^P^^^ a processor such as a desk PC or 

the like by comparing said programs to detemdne if there is * ^,"P^P standard cable such as a paraUel cable, 

discernible difference therebetween. TTie apparatus and and a svatchmg cu-cuit TTie switching circmt includes one or 

method thus can be used to test and/or compare the perfor- , , ^or^^v^^^y/ f^r selectively couplmg one of the programs to 

mance of recording apparatus or the medium for the record- \'^^^^y, ^^'^ f discussed above. The control box may 

|p also mclude display means for providing visual indication 

„ c u Ti • A associated with the operation of the device. The various 

B. Description of the Paor Art commands between the processor, control box and the 
In the fields of recording audio and video program switching circuit are exchanged using the standard lines of 

recordings, there is an impetus to improve the recording and 20 a parallel cable, 
reproduction quality by either improving existing recording 

media such as analog or digital magnetic tapes, solid state BRIEF DESCRIPTION OF THE DRAWINGS 

analog or digital memories, CDs, DVDs and so on or by ^^Ti- < u i ui i ^- p adv * 

. L J ¥T ' ^ ^ LI FIG. 1 shows a general block diagram of an ABX testing 

improving the hardware. However, a persistent problem d ' • 

with every new or improved apparatus or media is that it is 25 

difficult to quantify and objectively analyze whether the ^ shows a flow chart for performing an audio test 

performance of an apparatus or media because the quality of ^^"S °^ ^'G* 

recordings is normally determine subjectively by human FIG. 3 shows an ABX testing device being implemented 

testers. As a result, frequently there are heated and pro- using a laptop computer; 

longed debates in the field, every time a new apparatus or 30 FIG. 4 and FIG 4A and FIG 4B show details of the ABX 

media is introduced, especially if said apparatus or media testing device for the implementation of FIG. 3; and 

represents a major departure from the current industry piQs s^and 5B show a flow chart for the operation of 

standards or practices. testing device of FIGS. 3 and 4. 

OBJECTIVES AND SUMMARY OF THE 35 DETAILED DESCRIPTION OF THE 

INVENTION INVENTION 

In view of the above, it is an objective of the present piG. 1 shows the diagrammatical general ABX testing 

invention to provide a testing device which can be used to device 10 and ite elemente. The device 10 is used to compare 

provide reUable and repeatable indication of the accuracy of programs A and B received from two sources 12 and 14. The 

a recording device, medium or technique. device 10 includes a selector switch 16, a randomizer 18, a 

A further objective is to provide a testing device which data correlator 20 and a vote switch 22. The randomizer 18 

can be used to provide an accurate indication of whether two generates a random variable X which can have either the 

recordingsof a same audio or visual program are objectively value A or the value B. The switch 16 is a three position 

distinguishable. switch. In its first position, switch 16 connects program A to 

Another objective is to provide a testing device for its output. In its second position, switch 16 connects pro- 
differentiating two programs, said testing device being sub- gram B to its output. In its third position, the switch 16 
stantially automated to perfomi switching as well as data connects to its output either program A or program B 
processing. dependent on the current value of X. More specifically, if X 

Yet another objective is to provide a testing device of the 50 ^^^^^ ^» ^^^^^ connects A to its output. If X has 

kind described above, said device including or being based ^^"^ ^> switch 16 connects program B to its output, 

on a standard processor such as a laptop or personal com- The inputs lOA, lOB of device 10 are first connected to 

puter and a switching mechanisms controlled by the pro- the two sources 12, 14 and its output lOR to an appropriate 

cesser using a serial or parallel cable. reproduction device 22 selected to reproduce the programs 

Generally, a testing device constructed in accordance with ss dependent on the nature of the sources 12, 14. If 

this invention indudes a switching mechanism for switching sources 12, 14, for example, produce audio programs then 

in one mode selectively one of at least two programs A, B device 24 can be a high quality, stereo or multichannel audio 

to be reproduced in response to a command by a tester. In reproduction system. 

another mode, one program X of the two programs are Once the device 10 is connected as shown in FIG. 1, the 

reproduced randomly so that the tester has no way of 60 sources 12, 14 are initiated to produce audio programs A and 

determining which of the programs A or B is being repro- B. Preferably these two programs are identical, i.e., if these 

duced or played except through his senses (i.e., hearing for programs are music programs then programs A and B are the 

an audio program, sight for a visual program, a combination same musical selection, the only difference being either the 

of both for a video program). The tester is preferably given media used to store the programs A, B and/or the apparatus 

the choice of listening to A, B or X several times. He then 65 iised to replay the same. 

selects or votes for X being either A or B. His selection is The apparatus shown in FIG. 1 can be used to evaluate 

recorded and a new value for X is randomly generated. The whether there is any discernible difference between the 
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programs, i.e., in the particular case whether there is any specific to this application as described below. The circuit 44 

audible difference between a recording of a musical selec- includes two relays 80A, SOB, a first octal latch assembly 82, 

tion on a CD and are recording of the same program on an a second octal latch assembly 84, a keyboard decoder 86 and 

LP record. For this purpose, after the same, identical musical a D-type flip-fiop 88. The circuitry further includes two 

selection is recorded on a CD and a vinyl LP record, a CD 5 inverters 90, 92. 

player is used as source 12 to generate program A and a The keyboard encoder 86 is connected to pushbuttons 

record player is used as source 14 for program B. When any of these buttons is operated, the encoder 

The operation of the ABX device 10 is now described in 86 enables the DATA AVAIL line. This line activates flip- 
conjunction with the flow chart of FIG. 2. In step 100 the flop 88. The output Q of this flip-flop 88 is transmitted to the 
randomizer 18 generates a random output X which, as 10 laptop 40 via the ERROR line of cable 66 to indicate to the 
discussed above, is either an A or a B and the person laptop 40 to expect keyboard data. The DATA AVAIL line 
operating the device 10 does not know what this random also activates the latch assembly 84, This latch assembly 84 
variable is. receives the DATA OUT outputs of the encoder 86 and its 

Next, in steps 102-106 the operator uses the device 10 to internal latches (not shown) are set so that the output on lines 

selectively listen to programs A, B or X where X is defined OUT Q0-Q2 uniquely identifies which of the five keys has 

by the randomizer 18 as being either A or B. In FIG. 2, the been activated. This information is transmitted to the laptop 

selection of A, B and X is shown in that order, it being via the lines ACK, BUSY, PAPER END of cable 66, 

understood that the operator may listen to the programs in respectively, as shown, 

any order and may repeat any selection. After listening to The laptop 40 in response (as discussed more fully below) 

programs A, B and X (usually several times), the operator sends a command over the lines DATA 0-4 of cable 66. This 

then activates vole switch 22 to vote for X as being either A command is fed to latch 82 which in response turns on one 

or B (step 108). The correlator 20 gets both the variable X or more of the transistors Txl-4 on thereby energizing coils 

and the selection made by the operator in step 108 and in 80A, SOB , or lights 68A, 72Aas required. Lamps 68Aand 

step 110 tabulates the current vote. After step 110, a new 72A are associated respectively with (and physically incor- 

variable X is selected by randomizer 18 and a new test is ^ porated into) pushbuttons 68, 72 respectively. 

At the same time that the data lines DATA 0-A are 

This process continues for a predetermined number of energized, a signal is also fed by laptop 40 on the STROBE 

tests and/or for a predetermined time period, or the end of Uqc. This signal is fed through inverters 90, 92 causing the 

the musical selection. When the test given is complete, the latch 82 to set and latch assembly 84 to reset respectively. In 

tabulation from correlator 20 is reviewed. A high correlation this manner, when the STROBE line is energized, the system 

indicates that the sources are substantially identical. is ready for the next pushbutton to be activated. 

FIG. 3 shows a preferred embodiment for implementing Coil SOAis associated with. a DPST contact 94Aand coil 

the system of FIG. 1 for comparing a digital recording from 80B is associated with a DPST contact 94B. Thus, when 

a standard digital tape or CD with digital data stored coils 80A and 80B are selectively energized as described 

recursively a large number of times (for example 100) in a they respectively connect to the audio OUT lines either 

digital memory bank. program A (via contact 94A) or program B (via 94B). The 

In this embodiment, the ABX testing device includes a lap audio OUT lines are connected to the D/A converter/ 

top computer 40 used to control the testing procedure, a amplifier 46. 

listener control box 42, a switching circuit 44, an output D/A u should be appreciated that the scheme present above 

converter/amplifier 46 and two speakers 50, 52. Program A takes advantage of the bi-directional characteristics of the 

originates from a digital source 56, which in this example, standard printer cable 66. Obviously other types of uni- or 

is a standard CD player for playing an audio CD (not bidirectional cables may be used to generate the desired 

shown). Prior to a test run, the digital data on the CD has functions as well. 

been downloaded to a digital computer 58 with a standard 45 operation of the ABX device of FIGS. 3 and 4 is now 

memory bank 60 (consisting for example of several hard described in conjunction with the flow chart of FIGS. 5A and 

drives) and a standard monitor and keyboard 62. After this 5^ ^^^^ 2OO, the system is first initialized. In step 202, a 

data has been recorded, it has been digital recycled through ^ ^ ^ displayed on the screen of laptop 40 requesting the 

the memory bank 60 a predetermined times, so that, prior to tester to chose a delay D (d^cussed more fuUy below), the 

a test run, the memory bar* 60 contams, for mstance, the 5^ number N of votes for each test run, or optionally, whether 

copy. the test should be run continuously. After this information is 

The data thus generated is read out through a 16M token received, the actual test ran subroutine is started (step 204). 

ring 64 by the computer 58 and fed to switching circuit 42 As part of this step, the programs A and B are started, 

as program B. A cable 66 is used to exchange signals preferablysimultaneously.Thefiiststepof this subroutine is 

between the laptop 40, control box 42 and switching circuit 55 a check on whether a designated key on the keyboard of 

44. End 66Ais connected through a standard connector, such laptop 40, such as for example the SPACE BAR is 

as for example a parallel or printer port to the laptop 66. depressed. The tester pushes this key after the programs A 

Box 42 has three selector buttons 68, 70, 72 for listening and B have been started and he is ready to start a test run. 

to programs A, X and B respectively, and two voting buttons Once this key is depressed, in step 208, the laptop 40 uses 

74, 76 for voting for programs A or B as being program X. eo a random generator program to generate a random number 

Buttons A and B have a built in light which are lit as X which could be either an A or B corresponding respec- 

described in more detail below. tively to programs A or B. Next, in step 210, the lamps 68A, 

FIG. 4 shows a wiring diagram 45 for the listener control 72Aare turned on simultaneously to confirm that a test start 

box 42 and switching circuit 44. Cable 66 is a standard command has been received and acknowledged by the 

printer cable and includes eleven active lines with the 65 Iaptop40. The lamps further confirm that the connections of 

standard designations shown adjacent to the end 66A. Lap- the cable 66 have been properly made. Next, in step 212 a 

top 40 is programmed to use these lines for certain functions test is performed to determine if one of the selector buttons 
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68-72 has been depressed. When one of these selector 
buttons is depressed then in step 214 both relays 80A and 
SOB are de-energized. In step 216 a delay is initiated 
corresponding to the delay D set in step 202. At the end of 
this delay D, in step 218 one of the relays 80A, or SOB is 
energized in step 218. That is, if A or B is selected then relay 
80A or SOB is energized respectively. Moreover, the corre- 
sponding lamp 68A or 72A is also turned on to indicate to 
the tester what button selection has been received. When 
relay 80A is energized, the program A is connected to the 
output of the ABX device and this program is then fed 
through the D/A converter 46 to speakers 50, 52. If program 
B is selected, relay SOB is closed causing the program B to 
be fed to the speakers. The tester may repeat actuating relays 
80A, SOB, as often as he likes. If he selects button X then 
either program A or program B is selected by relays BOA, 
SOB in accordance with the current value of X. In this latter 
case the lamps 68A, 72A remain off. 

Importantly, each time one the relays is selected, even if 
the same relay is selected twice in a row, that relay is first 
de-energized (step 214), a delay D is generated, and then the 
same relay or the other relay is energized depending on the 
choice of the tester. This delay is important because it has 
been found that a perceptible difference may be present 
between two programs from two sources even if the two 
programs are content-wise completely indistinguishable 
because the sampling rates of the different sources may be 
either different or may be ofEset in time with respect to one 
another and testers with very fine ears may be able to detect 
this artifact. By imposing a delay between each selection, a 
gap is generated in the sound which confuses the ear of the 
tester sufficiently to overshadow and avoid this problem. For 
this purpose the delay D should be selected to be long 
enough to be at least an order of magnitude above the 
sampling interval. For example D may be in the range of 
50-500 msec. 

Once the appropriate relay is energized, the tester listens 
to the designated program. He may listen to A, B or X 
several times until he is satisfied that he can make a 
determination regarding whether X corresponds to program 
A or B. 

If in step 212 a button has been depressed but it' snot one 
of the selector button then it must be a vote button. In step 
218 a check is performed to determine whether vote button 
A has been depressed. The tester depresses this button when 
he subjectively determines that X corresponds to A. If A has 
been depressed then in step 220 a check is performed to 
determine if X is indeed A. If it is, then in step 222 a variable 
NR is incremented by one. If it is not, then in step 224 a 
variable NW is incremented. In step 218 if it is determined 
that the B vote button has been depressed then in step 228 
a check is performed to determine if X is B. Following this 
check, the variable NR is incremented if the vote is correct 
and the variable NW is incremented if the vote is incorrect, 
just like above. 

Next, in step 226 the two numbers NR, NW are summed 
to obtain a variable S. S indicated the total number of votes. 

Next, in step 228 a test is performed to determine if a 
continuous test run has been selected (i.e., the number N has 
not been set in step 202). If a continuous run has been 
selected then in step 230 a check is performed to determine 
if a designated (or, optionally, any) key has been depressed 
on the keyboard of laptop 40. Such a key activation is 
interpreted as an indication that the tester wishes to termi- 
nate the test run. If a key has not been depressed then the test 
run continues in step 210 by selecting a new value for X. 
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If instead of a continuous mode, the number of votes N is 
selected in step 202. then in step 232 a check is performed 
to determine if S has reached N. If not then the test is 
continued in step 208 by selecting a new value for X. If the 
5 predetermined number of votes N has been reached (as 
determined in step 232) or if the test run has been terminated 
in step 230, then in step the numbers N, NR, NW are 
displayed and the test run ends with step 236. In this step the 
relays 80A, SOB and the lamps 68A, 72A are de-energjzed. 
Optionally, in step 236 additional statistical analysis can be 
performed and the results displayed to show quantitatively 
the results of one or more test nms. These results provide 
objective information about whether programs A and B are 
tndy distinguishably or not. 

The apparatus described above is suitable for comparing 
analog and digital recording, CDs and DAT tapes, CDs and 
digital memory and so on. Moreover, while the invention is 
described in conjunction with the testing of audio programs, 
obviously the same equipment could be used to test audio/ 
visual programs such as DVD videos, laser disks and so on. 

The techniques illustrated herein can be easily extended to 
test and compare signals from three or more sources as well. 

Numerous modifications may be made other invention 
without departing from its scope as defined m the appended 
^ claims. 

We claim: 

1. A testing device for comparing two or more signals by 
selectively feeding said signals to a replay device, said 
testing device comprising: 

a randomizer for generating a random variable; 

a selector operative to couple selectively one of said 

signals to said replay device in accordance with said 

random variable; and 
a voting element operative to allow said tester to desig« 
35 nate the signal coupled to said replay device. 

2. The testing device of claim 1 wherein said selector 
includes a switch having a plurality inputs receiving respec- 
tively said inputs and said random variable and an output for 
coupling to said replay device. 

40 3. The testing device of claim 2 wherein said switch is 
adapted to operate in a first mode in which said switch 
connects one of said signals to said output in accordance 
with a command, and a second mode in which said switch 
connects one of said signals to said output in accordance 

45 with said random variable. 

4. The testing device of claim 3 further comprising a 
plurality of command generators, said command generators 
being operated by said tester to select a respective one of 
said signals when said switch is in said first mode. 

50 5. The testing device of claim 4 further comprising a 
display for displaying an indication confirming a command. 

6. The testing device of claim 1 further comprising a 
detector for detecting whether the signal designated by said 
voting element corresponds to the signal selected using said 

55 random variable. 

7. A testing device for use by a tester to detect whether to 
signals A and B are distinguishable by selectively feeding 
one of said signals to a replay device, said testing device 
comprising: 

60 a control member having a first control element for 
selecting signal A, a second control element for select- 
ing signal B, a third control element for selecting one 
of said signals A and B in accordance with a random 
variable so that said tester docs not know whether 

65 signal A or signal B has been selected; 

a switching circuit receiving said signals A and B and 
transmitting one of said signals A and B as an output 
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signal to an output port coupled to said replay device in detect the operation of said voting button and to deter- 

accordance with a command &om said control cle- mine whether a designated signal corresponding to the 

ments; and operation of said voting button corresponds to the 

a voting element operated by said tester to designate said program selected by said switching mechanism in 

output signal as corresponding to one of said signals A 5 J^^^ said second selector button, 

and B when said output signal is selected by said third ^ ^: ^^^^°S device of claun 12 wherem said control 

control clement mciudes a control mdication for mdicatmg the program 

8. The testing device of claim 7 furthet comprising a '*'^!f ^'?Zf*?f f '^^^^''''^^^^ • k- 
J. 1 , • J- , u c * J J *i? J 14. The testmg device of claim 12 wherein said swilchmg 
display to indicate when one of said first, second and third mechanism includes a relay operated by said command, 
control element has been operated. ^° 15. Hie testing device of claim 12 further comprising an 

9. The testmg device of claim 7 further comprismg an accumulator for accumulating the designations from said 
accumulator for accumulating designations from said voting voting button. 

element over a plurality of tests. 16. The testing device of claim 15 further comprising a 

10. The testing device of claim 9 further comprising a result display for displaying information related to said 
result display for displaying information related to said 15 designations. 

designations. 17. The testing device of claim 12 wherein said processor 

11. The device of claim 7 further comprising a command is further programmed to detect if a designation selected by 
generator generating commands corresponding to the opera- the tester through said voter button is identical to the 
tion of said control elements and a relay having a relay coil randomly selected program. 

operated by said commands and a contact operated by said ^ 18. The testing device of claim 12 wherein said processor 

relay coil for selectively switching said signals A and B to is further programmed to accumulate information related to 

said output port designations over a plurality of test. 

12. An ABX testing device for testing audio or video 19. The testing device of claim 18 further comprising a 
programs from two sources by selectively providing said result display for displaying said information, 
programs to a replay apparatus, said testing device compris- 25 20. The testing device of claim 12 further comprising a 
ing^ randomizer for generating a random variable, said random 

a processor having a standard port; variable being used to control a random selection by said 

a control box with a control box having a first selector switching mechanism of one of said programs A and B. 

button operated by a tester for selecting one of said ^1. The testmg device of claim 20 wherem said processor 

programs A and B, a second selector button for ran- ^ programmed to generate said random variable, 

domly selecting one of said programs A and B and a ^^^^"^^ ^^^^^^ ^1^^°* wherein said standard 

voting button; P^^^ ^ ^ P^^^l^^l P°^t- 

. « u • « • ■ -J A J n 23. The testing device of claim 12 further comprising a 

a swilchmg mechamsm receivmg said programs A and B ^i . c j 

J 1 , * r • J A J ^^^^y generator for generating a preselected delay, said 

^sclecUyelycomectingonc ofsaidprogranisA 35 switching mechanism connectiag one of said programs A 

B to ai. output port connected to said replay dev.ce in ^ g j„ ^^^^ preselected delay. 

accordance With a command; and tv * 4 - j • * i • 'vi u j 

' 24. The testing device of claim 23 wherein said prese- 

a standard connector coupling said processor through said lected delay is a programmable parameter stored by said 

standard port to said control box and said switching processor. 

mechanism; 40 25. The testing device of claim 23 wherein said prese- 

wherein said processor is programmed to detect the lected delay is in the range of 20-500 msec, 
operation of said selector buttons to generate said 

command, said processor being further programmed to * 4< * ♦ * 
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